Search for: All records

The increase of computer processing speed is significantly outpacing improvements in network and storage bandwidth, leading to the big data challenge in modern science, where scientific applications can quickly generate much more data than that can be transferred and stored. As a result, big scientific data must be reduced by a few orders of magnitude while the accuracy of the reduced data needs to be guaranteed for further scientific explorations. Moreover, scientists are often interested in some specific spatial/temporal regions in their data, where higher accuracy is required. The locations of the regions requiring high accuracy can sometimes be prescribed based on application knowledge, while other times they must be estimated based on general spatial/temporal variation. In this paper, we develop a novel multilevel approach which allows users to impose region-wise compression error bounds. Our method utilizes the byproduct of a multilevel compressor to detect regions where details are rich and we provide the theoretical underpinning for region-wise error control. With spatially varying precision preservation, our approach can achieve significantly higher compression ratios than single-error bounded compression approaches and control errors in the regions of interest. We conduct the evaluations on two climate use cases – one targeting small-scale, node features and the other focusing on long, areal features. For both use cases, the locations of the features were unknown ahead of the compression. By selecting approximately 16% of the data based on multi-scale spatial variations and compressing those regions with smaller error tolerances than the rest, our approach improves the accuracy of post-analysis by approximately 2 × compared to single-error-bounded compression at the same compression ratio. Using the same error bound for the region of interest, our approach can achieve an increase of more than 50% in overall compression ratio. 

Abstract This paper describes the atmospheric component of the US Department of Energy's Energy Exascale Earth System Model (E3SM) version 3. Significant updates have been made to the atmospheric physics compared to earlier versions. Specifically, interactive gas chemistry has been implemented, along with improved representations of aerosols and dust emissions. A new stratiform cloud microphysics scheme more physically treats ice processes and aerosol‐cloud interactions. The deep convection parameterization has been largely improved with sophisticated microphysics for convective clouds, making model convection sensitive to large‐scale dynamics, and incorporating the dynamical and physical effects of organized mesoscale convection. Improvements in aerosol wet removal processes and parameter re‐tuning of key aerosol and cloud processes have improved model aerosol radiative forcing. The model's vertical resolution has increased from 72 to 80 layers with the extra eight layers added in the lower stratosphere to better simulate the Quasi‐Biennial Oscillation. These improvements have enhanced E3SM's capability to couple aerosol, chemistry, and biogeochemistry and reduced some long‐standing biases in simulating tropical variability. Compared to its predecessors, the model shows a much stronger signal for the Madden‐Julian Oscillation, Kelvin waves, mixed Rossby‐gravity waves, and eastward inertia‐gravity waves. Aerosol radiative forcing has been considerably reduced and is now better aligned with community best estimates, leading to significantly improved skill in simulating historical temperature records. Its simulated mean‐state climate is largely comparable to E3SMv2, but with some notable degradation in shortwave cloud radiative effect, precipitable water, and surface wind stress, which will be addressed in future updates.